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ALGEBRA  OF  NEURON  MATRICES 


K.  G.  Agababyan 

(Presented  by  Academician  V.  M.  Glushkov,  1-25-1971) 

rt  ..  ~  f  ■ .7 .  -• r 

This particle  examines  algebra,  the  principle  of  construction  of 
which  involves  certain  properties  of  sensory  systems  in  the 
information-processing  sense, ( 1 2— 5 1  et  al.). 


The  concept  of  neuron  matrices  and  neuron  operators  is 
introduced.  The  elements  of  the  neuron  matrices  are  the  output 
signals  of  neurons  of  a  given  layer.  It  is  assumed  that  each  layer 
consists  of  neurons  of  the  same  type,  while  the  signals  between  the 

layers  travel  only  in  one  direction  -  from  the  receptor  field  to  the 

.  ,  —  /.  / 

k-th  layer.  '  •'  -  .  s  ->  -  . 


We  introduce  the  following  function  axiomatically: 


I  = 


>-k 


Hi  V»:  ‘ 


«2S  \  U'ij"  —  afrt)dt  —  rk 


»-»  ,<*/ 
0 


npn  a  2  S  ^  (/T  —  c.^"V/>p*, 

d*i 

DfnaJ  2  ^  V.J  —af^)d{^p„, 

(!') 


key:  npw=with 

where  >.'  is  the  output  signal  of  the  ij-th  element  of  the  k-th  layer, 
>■  -  coefficient,  r  -  threshold,  i  -  horizontal  coordinate,  j  - 
vertical  coordinate,  and  t  -  time,  i,  j,  k,  m,  u»f  m,  n,  o,  /5,  and  7 
take  on  integral  values.  It  is  assumed  that  6/ sS  fr1’  ^  where 
t  —  The  superscript  of  the  symbol  used  denotes  the  layer 
number. 

Definition  1.  The  element,  which  performs  operation  (I)  with 
/.  =  1,  a  =  1.  !••  =  Hi  =  l.  a  =  0.  flj 1  =J(t).ve  will  call  a  receptor,  where  I  ( t ) 
is  the  input  signal  of  the  receptor. 
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Definition  2.  The  set  of  receptprs  arranged  uniformly  in  a 
two-dimensional  space  in  the  form  of  matrix  MxN  we  will  call  the 
receptor  field. 

Definition  3.  The  compact  set  of  elements  of  the  k-th  layer 
whose  outputs  are  connected  with  one  element  of  the  n-th  layer  we 
will  call  the  receptive  field. 


Definition  4.  r^tr^x^j]  is  an  operator,  which  breaks  up  any 
given  matrix  into  blocks  measuring  and  performs  operation  (I) 

with  each  block  with  a  =  1.  n>  M:  =  a  =  0,  where 

—  l.  >*=(/.-,  —  1  )t|: -r  l.  When  t? ,*17 ,*»] ,  we  will  write  the 
operator  in  the  form  of  re  t ] .  It  is  obvious  that  the  operator 
r0[*7ix*?a]  transforms  the  receptor  field  to  receptive  fields. 

Definition  5.  r,[I]  is  an  operator,  which  performs  operation 

(I)  over  the  columns  of  any  given  matrix  with  a  —  1,  n,  =  1,  =  A’, a  =  0. 


The  F  [—].  is  the  modality  of  the  operator,  where  ji,=M,  u  2  =  1.  ^ 
and  M  are  vertical  and  horizontal  dimentions  of  the  matrix, 
respectively. 


Definition  6.  !%[— ]  is  an  operator,  which  performs  operation 

( I )  over  any  given  matrix  with  a  —  1.  n,  =  =  1.  m  =  n.  *  -  —  1.  •  +  !•  Y  — 
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The  modalities  of  the  operator  are  r:[— J.  r2j— ]|.  rs[- ]j.  where  /5 
and  7  assume  values  p  =  /  —  1.  >■  =  /-  P  —  i.  y  =  ;  +  l,  P  =  i,  y  =  /  —  l. 


Definition  7.  ra[  +  ]  is  an  operator,  which  performs  operation 
(I)  over  any  two  given  matrices  of  identical  size  with  a=  1. 
n,  =  n.  —  1-  m  --  »■  u=  -l.  p  =  i,  v  = This  is  an  operation  of  addition  of 
the  neuron  matrices. 


Definition  8.  J'.[  — }  is  an  operator,  which  performs  operation 

( I )  over  any  given  matrix  with  «  =  J.  p:  =  p-  —  1-  m  =  n,  u  =  1.  p  =  i  +  1.  v  =  ?• 


The  modality  of  the  operator  is  r.|-r]i,  where  /3=i,  >=j+l.  Here 
A=i  +  1  is  equivalent  to  p«i-l,  while  7=j+l  is  equivalent  to  7=j-l. 

Definition  9.  r,[-]  is  an  operator,  which  performs  operation 

(I)  over  any  two  given  matrices  of  identical  size  with 
a  =•  1,  Mi  =  =  1,  m  ¥=  n,  a  —  —  1,  p  =  i,  y=-  This  is  a  subtraction  operation 
for  the  neuron  matrices. 

Definition  10.  •«[-!-)  is  an  operator,  which  performs  operation 


(I)  over  any  two  given  matrices  of  identical  size  with 


a  =  1,  n,  =  no  =  1,  m  ¥=  n.  a  =  1,  p  =  i  +  1,  V  +  h 


The  modalities  of  the  operator  are  r.f+J,  r«[-rlt.  I'.[-rH.  where  ft  and 
7  assume  values  p  =  i  —  1.  y  = ;.  p  =  /  .  \  =  /  -►- 1.  p  =  i. 

Definition  11.  F,[— ]  is  an  operator,  which  performs  operation 

(I)  over  any  two  given  matrices  of  identical  size  with 

a  —  1.  n,  —  (i;  =  1.  m  =**  n,  a  =  —  1.  fl  ==  i  +  \  =  /• 

The  modalities  of  the  operator  are  I\|  — ].  1'- [ — 1A.  n[— ]|,  where  p  and 
7  assume  values  P  =  i  —  1.  v  =  /,  p  =  i.  y  —  j  —  1.  P  =  J,  v  =  ;  -  l. 

Definition  12.  iVpr]'  is  an  operator,  which  performs  operation 

( I )  over  any  given  matrix  with  a  =  <j  (r).  M,  =  (j.  =  1.  m  =  n.  u  =  1.  p  =  /  -r  M  =  )■ 

The  modalities  of  the  operator  are  r,f*-Tj'.  r,[+] where  p 

and  7  assume  values  p  =  *  —  i.  y  =  /.  p  ==  /.  y  =  /  -f  i.  p  =  i.  y  -i  -  1.  Here  <pU)  is 

defined  as  follows:  <t  l')  =  t,~  t,.i.  =  (/,_/„) l:  —  So/  v>  hence 


where  s,  is  the  distance  between  the  elements  from  which  the  entries 
of  a  neuron  can  be  excited,  v  -  speed  at  which  an  image  moves  over 
the  receptor  field,  rt.  -  speed  at  which  excitation  propagates  through 
the  entries  of  a  neuron  l  and  l,.  It  is  assumed  that  /,  >  1 .  where 
and  /.  are  lengths  of  the  right  and  left  entries  of  a  neuron,  and 
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<p(r)  satisfies  the  inequality  0<4>(»')<t1. 

For  the  group  of  operators,  where  a=o(f),  we  will  assume  that 
/‘7'=const,  /£'  =  const,  =0 ,  and  t=l. 

For  the  operators,  where  a  =  1.  m  =  m  =  1.  we  will  assume  that 
/.  =/„  while  for  the  operators  r0[r|;  x  %],  r,[I].  r,[— ]:  /£  ^  ^ where  l  is 
the  length  of  the  ij-th  entry. 

Definition  13.  r,[—  ]"  is  an  operator,  which  performs  operation 

(I)  over  any  given  matrix  with 

o  =  <*('').  =  M:  =  1,  m  =  n  a=— l.  p  =  t—  1.  \  =  i .  The  modalities  of  the 

operator  are  r.pj",  r,[— ]" f,  r,[— ]"  i.  where  /3  and  7  assume  values  /3=i-l, 

7  =  jr  P~  i  ,  7=j  +  l#  P~  i ,  and  7= j-1 . 

Definition  14,  r,«[-r]'  is  an  operator,  which  performs  operation 

(I)  over  any  two  given  matrices  of  identical  size  with 
a  =  <f  (i).  (i,  =  (ij  =  l,m*n.a=l.p  =  i+  !,>•  =  / 

The  modalities  of  the  operator  are  r.ofVj'.  r„[4-]';.  where  p 

and  7  assume  values  p=  /  —  !. >  = p  =  1,  \  =  ;  -i-  1,  p  =  v  = ;  —  1. 

Definition  15.  I„"f— "j"  is  an  operator,  which  performs  operation 

(I)  over  any  two  given  matrices  of  identical  size  with 


The  modalities  of  the  operator  are  r„f—  r, where  /3 

and  7  assume  values  /J=i-1,  7  =  j ,  /3=i,  7=j+l,  /3=i ,  and  7=j-l. 

Definition  16.  is  an  operator,  which  performs  operation 

(I)  over  any  two  given  matrices  of  identical  sizes  with 

a  —  ,  (t  ).  ji,  =  n;  =  1.  m  =  r.  a  —  1.  P  =  i,  y  =  /• 

Definition  17.  f13[-]  is  an  operator,  which  performs  operation 

(I)  over  any  two  given  matrices  of  identical  size  with 

a  =  f  (r)  u.  =  11=  1.  m  ?=  ».  a  =  —  1.  (5  =  i.  \  =  !■ 

It  is  not  difficult  to  see  that  the  addition  and  subtraction 
operations  for  the  ordinary  matrices  are  particular  cases  cf  addition 
and  subtraction  of  the  neuron  matrices.  To  prove  this,  it  is 
sufficient  to  substitute  >..  =  1.  >[,*’  =  0.  1  =  1.  pk  =  0,  y;j"=  ronst.  p  =rvn?tin 
the  corresponding  expressions  and  then,  after  substituting 
f,‘p  —  c  ,  f\p'—a  .  f\.t'  — •  h ..  we  will  obtain:  c  —a,  b ,  and  c4  =  a  —  ^  i.e., 
C=A+B  and  C=A-B. 

When  =  >.,(o.  />.  =  pJt) ,  this  algebra  makes  it  possible  to  model 
certain  pathological  properties  of  the  sensory  systems. 
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We  note  that  the  neuron  matrix  does  not  have  to  have  a 
rectangular  form  in  order  to  perform  the  operation  over  the  neuron 
matrices.  It  can  have  an  arbitrary  form  consisting  of  elements 
densely  arranged  in  such  a  way  as  to  permit  their  ordering. 


Let  us  consider  some  of  the  elementary  properties  of  the  neuron 
matrices . 


Theorem  1.  Let  n  =  r0[r  ^  n.]  (.4)  =  1  Jn-  ■  n  1  < 


Theorem  2.  r.[Nxl]M)  is  equivalent  to  r,  [I]  (.4).  and  I%[ !  >.  V)  i.i ,  is 
equivalent  to  r,[  l  j  (-4). 


Theorem  3.  Let  .4s  (4^.4).  The  following  relations  are  valid: 

r  [  — ] (.4)  =  r:[-j(.4)=l-.  r:[-i  *  (.4)  =  .4,  *. 

r;[-]  ;  (A)  =A, 

Here  4  is  a  set  of  matrices  for  whose  elements  •£*=  =  .. .  =  •'.*,%  =  is 

valid,  and  4  -  a  set  of  matrices  for  whose  elements 

=  f.'  =  . . .  =  fCt’s  —  "  is  val  id. 


Theorem  4.  Let  1[-Ji.4i=.4  — .  where  a  -  =  )  — .  The  following 
relation  is  valid:  i\j  )i.i  — )  =*=  4 


Theorem  5.  i  [  -r]  (.1.  B)  =  i  ,  —  1  IB.  A ). 
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Theorem  6.  Let  A  B.  I\r  —  ]  (.4.  /?)  *  I  i 


Let  us  examine  the  operator  variants. 


a)  a  =  1.  /''*■  =  j\y  =  "•  t  =  l.  ve  will  write  the  operators 


in  the  form  r  ft]].  r,[I],  f..[— ].  r,[-rj.  T.[  +  ]  ,  etc, 


b)  Only  the  absolute  value  of  the  difference  between  •, "■  and 
is  estimated. 

We  will  write  the  operators  in  the  form 

r  [  —  ].  r  [  —  ]  r  f  — ].  r-f—  |.  r-[—  ]|.  r.[— )'.  r»[-J ,  etc.  For  this  variant, 
P=  i  +  1  is  equivalent  to  /3=i-l,  while  y*j+l  is  equivalent  to  >  =  j-l. 


Cases  a)  and  b)  are  valid  simultaneously.  We  write  the  operators 
in  the  f orm  T\f  — ).  f'J  — )  j.  f  .[  —  ].  I  -f- ]•  T-[  —  ]  ■  ,  etc. 


Certain  properties  of  the  neuron  matrices  were  examined  in  [i]. 
In  addition  to  describing  and  analyzing  the  operation  of  the  sensory 
systems,  this  algebra  can  be  used  also  for  solving  a  class  of 
problems,  which  do  not  relate  to  neuron  networks. 
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